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1 .  Introduction. 

The  prediction  theory  of  second  order,  and  of  Gaussian,  stationary  processes 
has  a  vast  literature  developed  over  the  last  several  decades  and  is  now  standard; 
see  for  example  Rozanov  (1967).  On  the  other  hand,  the  prediction  theory  of 
p-th  order,  0<p<2,  and  in  particular  of  stable  processes  has  only  recently  been 
the  subject  of  intense  investigation. 

Here  we  concentrate  on  the  prediction  of  stationary  stable  sequences.  The 
main  difficulty  compared  with  the  Gaussian  case  arises  from  the  need  to  work  in 
Banach,  rather  than  Hilbert,  spaces,  where  orthogonality,  projections,  and  the 
like  have  by  far  weaker  properties  and  are  much  more  unwielding  in  their 
structure.  Another  source  of  difficulties  is  due  to  the  richness  of  the  class 
of  stationary  stable  processes,  which  are  fully  described  in  Hardin  (1982). 
Stationary  stable  processes  include  in  particular  moving  averages  of  independent 
stable  r.v.'s;  harmonizable  processes,  i.e.  Fourier  transforms  of  stable 
processes  with  independent  increments;  sub-Gaussian  processes;  etc.  Surpri si nqly , 
all  these  three  classes  (and  many  more)  are  actually  disjoint  (see 
Cambanis  and  Soltani  (1984)),  while  all  stationary  Gaussian  processes  are 
narmonizable. 

At  this  stage  of  its  development  the  study  of  stable  processes  is  frequently 
proceeding  by  a  comprehensive  study  of  special  subclasses,  such  as  moving  averaoes, 
harmonizable,  etc.  For  instance  parameter  estimation  of  autorearessi ve 
processes  has  been  developed  in  Hannan  and  Kanter  (1977),  and  prediction  of 
autoregressive  moving  averages  (ARMA)  has  been  considered  in  Cline  and  Brockwell 
(1985).  Here  we  concentrate  on  harmonizable  stable  processes.  Even  though 
they  are  never  ergodic  (see  LePage  (1980)  and  Cambanis  et  al.  (1984)), their 
spectral  density  can  be  estimated  consistently  (Masry  and  Cambanis  (1984)). 
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'ved iction  theory  for  harmonizable  processes  with  infinite  second  moments  was 
initiated  by  Urbanik  (1970).  The  first  results  in  the  stable  case  were  obtained 
by  Hosoya  (1978)  and  (1982)  for  one  step  ahead  prediction.  The  general 
multi-step  case  was  considered  by  Cambanis  and  Soltani  (1984).  The  problem 
of  interpolation  has  been  considered  by  Pourahmadi  (1984)  and  also  by  Weron 
(1985)  in  a  more  general  set-up  along  with  some  ergodic  properties. 

Here  we  pursue  the  development  of  prediction  theory  of  harmonizable  stable 
processes  with  a  view  to  determine  the  extent  to  which  the  Gaussian  (or  second 
order)  theory  extends  to  the  non-Gaussian  stable  case.  Earlier  works  mentioned 
above  revealed  that  the  one  step  ahead  predictors  are  given  by  the  same  recipe 
as  in  the  Gaussian  case  (with  the  same  spectral  density),  but  when  predicting 
two  or  more  steps  ahead  the  non-Gaussian  stable  predictors  are  generally  different 
from  their  Gaussian  counterparts  (Cambanis  and  Soltani  (1984)).  We  show  that 
for  stable  processes  there  are  three  different  kinds  of  predictors  one  may 
consider,  all  of  which  coincide  in  the  Gaussian  case  and  hence  are  natural  to  be 
considered  and  studied  in  this  case.  One  of  them  is  the  metric  predictor, 
which  minimizes  the  distance,  and  which  has  been  considered  by  the  authors 
mentioned  above.  Two  further  predictors,  which  minimize  appropriately  defined 
angles,  and  which  we  will  call  "angle"  predictors,  are  introduced  and 
studied. 

Specifically,  in  Section  3  we  present  spectral  and  time  domain  criteria 
for  regularity  (Theorem  1).  The  spectral  criteria  are  log-integrability  of  the 
spectral  density  (Hosoya  (1982)  and  Cambanis  and  Soltani  (1984))  and  a  spectral 
density  factorization  analogous  to  the  Gaussian  case.  The  time  domain  criteria 
are  a  moving  average  representation  in  terms  of  an  orthogonal,  but  not  indepen¬ 
dent,  harmonizable  stationary  stable  seguence,  the  innovations  of  the  process; 
ana  a  corresponding  orthogonal  moving  average  representation  of  the  one  step 
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ahead  metric  predictors.  Unlike  the  Gaussian  case,  here  truncation  of  the 
orthogonal  moving  average  representation  does  not  generally  produce  the  two  or 
more  steps  ahead  metric  predictors:  in  the  non  Gaussian  stable  case  the  moving 
average  coefficients  have  to  be  changed  with  each  further  truncation.  However 
the  truncation  of  the  moving  average  does  in  fact  produce  the  m-step  anead 
right  angle  predictors (see  Section  4).  A  corresponding  Wold  decomposition  is 
described  in  Theorem  2,  and  it  is  shown  (Proposition  9)  that  the  moving  averaoo 
and  hence  also  the  Wold  decomposition  obtained  here  is  the  best  possible,  and  tnese 
stable  processes  cannot  have  any  of  the  stronger,  and  more  versatile.  Wold 
decompositions  considered  in  Cambanis  et  al .  (1985). 

Section  4  deals  with  the  important  question  of  the  existence  o*  prediction 
filters,  i.e.  of  convergent  series  representations  of  predictors  in  terms  of 
the  observed  values  of  the  process.  The  main  result  of  the  paper,  Theorem  3, 
provides  spectral  and  time  domain  criteria  for  the  r.v.'s  of  the  process  to 
form  a  Schauder  basis  for  its  linear  space.  It  is  remarkable  that,  in  spite  of 
the  considerably  different  geometry  of  the  non-Gaussian  stable  case,  the  positivity 
of  anqle  between  past  and  future,  and  the  positivity  of  distance  between  past  and 
future,  turn  out  to  characterize  again  the  Schauder  basis  property.  The  spectral 
criteria  are  likewise  analogous  to  those  in  the  Gaussian  case.  Under  any  one  of 
tnese  criteria  all  predictors  can  be  realized  by  filters  acting  on  the  observed 
part  of  the  process,  and  indeed  all  estimation  problems  have  solutions  which 
can  be  so  real i zed . 

An  important  related  question  is  to  find  conditions,  stronger  than  regularity 
and  weaker  than  those  in  Theorem  3,  which  are  sufficient  for  predictor  filters  to 
exist.  For  the  second  order  processes  this  question  has  been  the  subject  cf  study 
by  several  authors:  Akutowicz  (1957),  Masani  (1960),  Miarnee  and  Salehi  (1983), 
Pourahmadi  ( 1984) ,( 1985) ,  and  Bloomfield  (1984).  Some  such  conditions  are  niven  in 
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Proposition  13,  which  is  inspired  by  the  conditions  in  Bloomfield  (1984).  Also 
the  relationship  between  the  existence  of  a  filter  for  the  orthogonal  innovations 
and  for  the  predictors  is  discussed. 

The  analysis  requires  a  systematic  development  of  various  properties  of 
r.v.'s  in  the  linear  space  of  a  harmonizable  process.  These  properties  are 
common  to  all  isotropic  linear  spaces  of  complex  symmetric  oi-stable  (S«S)  r.v.'s  (i.e. 
with  radially  symmetric  distributions)  and  are  presented  in  Section  2.  It 
turns  out  that  complex  symmetric  stable  linear  systems  that  are  isotropic  share 
simila  properties  with  real  symmetric  stable  linear  systems,  while  the  same 
is  not  true  for  general  (not  necessarily  isotropic)  complex  symmetric  stable 
linear  systems  (see  Cambanis  (1983)).  Section  2  thus  deals  with  isotropic 
complex  stable  systems,  and  character!- zes  the  linearity  of  conditional  expecta¬ 
tion  (Proposition  6),  introduces  the  concepts  of  angle  and  of  angle  projection 
and  develops  their  properties  (Propositions  4,5  and  7)  and  shows  that  positive 
angle  between  subspaces  is  equivalent  to  positive  distance  (Proposition  3). 
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2.  Hamonizable  and  other  isotropic  stable  systems:  Distance  and  angle. 

Harmoni zable  processes 

A  harmoni zable  complex  SaS  process  X  =  t Xp ,  n=0,+1 , . . .}  with  spectral  measure 
a  finite  measure  on  (-7-,-]  is  defined  through  its  finite  dimensional  charac¬ 
teristic  functions 

j  rV  j 

E  exp-fi  Re  i  z  X  1  -  exp  {-  I  7  z  e"in  !  ldp(e)}. 
n=k  n  n  n=k  n 

and  thus  is  strictly  stationary;  or,  equivalently,  it  is  defined  through  its 
spectral  representation 

Xn  =  |  e~in'd7.(>) 

where  Z  is  a  complex,  independently  scattered,  isotropic  S tS  measure  on  the 
Borel  subsets  of  (-tt.tt]  with 

E  exp  (i  Re  j  fdZ  ,l  =  exp  {-!  |  f  j adp ) 

for  all  f  L  l(:  )  (see  Hosoya  (1982),  Cambanis  (1983)).  The  correspondance  f  ■+  /  fdZ 

t  Y 

is  an  isomorphism  between  Lu(;.)  and  the  closure  in  probability  M  of  the  linear 
space  of  the  process  X  =  ( Xn ,  -■•'n^i,  which  sends  e’in  to  X  .  Thus  every 

r.v.  Y  in  is  of  the  form  /  fdZ  for  some  f  in  L1(t.),  and  has  an  isotropic, 

i.e.  radially  symmetric,  distribution.  The  latter  is  evident  from  the  ch.f. 
of  /fdZ,  whence  replacing  f  by  (r-is)f  we  have 

E  exo  ii(r  Re  fdZ  +  s  ImifdZ)r  =  exp  • -(r^+s^)  1 ' f  1  d ; ;  • . 

)  )  j 

X 

Some  further  properties  of  the  r.v.'s  in  M  which  will  be  needed  in  subsequent 
sections,  are  generally  valid  for  linear  spaces  of  complex  S <S  r.v.'s  with 
radially  symmetric  distributions,  and  we  therefore  develop  them  now  in  this 
set  up. 


Isotropic  complex  stable  systems . 

A  complex  r.v.  X  =  +  iX^  is  called  isotropic  S  iS  if  X^  and  are 

jointly  S-xS  with  radially  symmetric  distribution,  i.e.  E  exp  (i  (r-jX^  +  r^X^)  •  = 

2  2/2 

=  exp  {-c(r1  +  r ^ )  1,  or  in  complex  notation  with  r  =  +  ir^, 

E  exp  •:  i  Re  rX’-  =  exp  ;-C;r!  '} . 

A  complex  process  X  =  {X^.,  t;T}  is  called  isotropic  S  vS  if  every  finite  complex 

linear  combination  > z ^ X t  is  a  complex  isotropic  SaS  r.v.  Then  there  exists  a 

n 

measure  space  (l,7,u)  and  complex  functions  f  •  L UT,  such  that 

_  N  N 

E  exp  fi  Re  r  »  :  X.  ■  =  exp  ; -  r ' ' 1  7  z  f .  ' ■ 

r.-l  n  n=l  n 

where  f  denotes  |]fl|  (Hardin  (1982)).  Equivalently,  if  Z  is  a  complex 

'  La(p) 

independently  scattered,  isotropic  S»S  measure  on  (I,F,u),  i.e.  for  all 
disjoint  sets  I.|,...,I  c  l  of  finite  p-measure,  Z(I^ ),. . .  ,Z(In)  are  indepen¬ 
dent  with  E  exp  ii  Re  rZ  ( I  ^ )  >  =  exp  t  -  J  r  j  ‘-,.(1^)},  so  that  for  all  f  <-  Ll(;.), 

E  exp  ;i  Re  r  fd Z }  =  exp  { - 1 r  1  ^  'jfMa;, 

J  a 

then  the  stochastic  process  i/jft(s)dZ(s),  t  <  T-  is  stochastically  equivalent 

X 

to  X.  we  then  say  that  { X t ,  t  <.  T}  is  represented  by  >  f ^ ,  t  ■'  T } .  If  M  is 

tne  closure  in  probability  of  the  linear  span  of  IX^,  t  c  T-,  then  the  corre- 

x 

spondance  extends  to  an  isomorphism  between  M  and  the  subspace 

X 

sp-ft,  t  T  of  L '(..).  M  is  then  a  complex  isotropic  SaS  space  and  every  Y 

X  t 

in">  is  represented  by  some  f  in  L*(,i).  (For  general,  not  necessarily 
isotropic,  complex  S <S  processes  see  Hosoya  (1978)  and  Cambanis  (1983)). 

The  following  moment  properties  will  be  needed  in  the  sequel.  They 
extend  to  the  complex  isotropic  case  properties  known  from  the  real  case: 
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the  real  analog  of  (i)  is  immediate  and  of  (ii)  was  established  in  Cambanis 
et  al  .(1985). 


v  - 

Proposi tion  1 .  (i)  Assume  0< <<2  and  let  Y-  M  be  represented  by  f  •  L  l{ 


1/2 

Then  the  pair  (Re  Y,ImY)  has  the  same  distribution  as  the  pair  /2' 1 f;!  R  '  (N,,N«), 
where  R  is  a  positive  t/2  stable  r.v.  with  E  exp(-uR)  =  exp  (-u'^),  u  "■  0, 
and  is  independent  of  the  iid  standard  normal  r.v.'s  and  Moreover,  for 
all  0-  p<  i, 

tE:rp,i/P .  :mi.  * cPt,  it!.. 


\  i 

(ii)  Assume  l'i<2  and  let  Y^,  Y^  H  be  represented  by  f^,f^  >.  Ll(, .). 
Then  for  every  1-  p-'  < , 

EY^"^  /f i f 2  * ~ 1 '  du 


E !  Y?  )  P  /)f2.!ld;. 

where  for  .>0  and  complex  z  f  0,  z'' '  =  ,  z j '  z. 


Proof,  (i)  Since  Y  c  MA  we  have  Y  =  ,'fdZ  for  some  f  ■  Ll(  ). 

Putting  r  =  r-j  +  irj  we  obtain 

E  exp  i  (r-jY^  +  r^Y^)  I  =  E  expii  Re  r  /  fdZ;  =  exp  1  -(r^+r^)  |’fi 
The  rest  f o'1  lows  from  (cf.  Theorem  7.2  in  Masry  and  Cambanis  (1984)) 


E  exp  i.'2,  f ,  ;  iR1//2(riN1+r„‘(2)  i  =  E  exp)  -  i  !  f  t  ^R(  r^+r^)  =exp-. -( r^+r^)  ^  f  . 
(ii)  The  calculation  is  similar  to  that  on  page  357  of  Kothe  (1969). 


•or  complex  numbers  z  t  and  w,  and  real  we  have  d  z  +  >w  p  / 

'  d V  f 

and  thus 


P  z  P"^Re(zw) 


j-  i  ,z+>wlp-i 1  z+-  iwip>.  _n=p;ziP  2  Re(zw)  -  i  Re(ziw) 

Ur  f\  -U 

=  p1 z, P'2  zw  =  pz  P_1  w. 


Using  part  (i)  we  obtain 


PeY1Y2P"1>  =  |  *  EiY2+eY-,  f P  -  i  E!Y,^iY 


_  rP  d__. 
p,  *  dc 

■‘l!f2+ifl 

!  P 

1  1  < 

i  .  1  f ; 

=  CP  p 
p.  ‘ 

f  i 1 P"  ' 

'  2'  -rx 

!  i  f  2 : ' 

4-2 

rP  ' 

=  p  C* 

K  P,  f 

If  P-  ‘ 

■  2’  'a 

j  f  1  f2 

' 

t 

2  1'  /  =0 

r  :  I  P  ; 


2  1 


2  1 


d... 


Couoled  with  E ' Y0  p  =  CP  !  this  establishes  (ii). 


iP 


2  '2  «’ 

In  the  Gaussian  case  <  =  2  the  moment  expression  in  (i)  holds  for  all 
p  >  0  and  in  (ii)  for  p  -  2  as  well. 

Now  putting  '  Y  =  ;  f.  we  have  that  i ;Y :^A>  defines  a  norm  when 

X 

]<  s2  and  a  quasi-norm  when  0<  <  1  on  M  ,  which  metrizes  convergence  in 
probability  (Cambanis  (1933))  and  which,  by  (i)  of  Proposition  1,  is  equivalent 
to  convergence  in  Lp(/>),  0-  p-  .. 

^  *i  w'n  v’/\r\w'Ar  nrt  A/1  K\/  ■f  . 

r  2 


When  1  <  »<2  and  Y^,  •  M  are  represented  by  f n ,  f9  •  L‘(.,),  the  covaria¬ 


tion  of  Y^  with  Y^  is  defined  by 


.-1: 


[Yr  Y2](-  .  f1f2  d. 


and  by  (ii)  of  Proposition  1  we  have  for  all  Ip  <  (provided  Y^O) 


[Y,,  YJ  EY .  Y„ 


p-l> 
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By  Holder's  inequality  we  have  ([Y^Y,,]^  ,  ^2  ,  -  Yi  :  Y? 

with  equality  if  and  only  if  Y1  =  zY2  for  some  complex  z.  The  covariation  of  a 

hanr.onizable  process  is 


,X  1  .  r  e-i(n-"'>  CU-), 


n  m  t 


tne  familiar  form  of  the  covariance  of  a  stationary  nrocess.  In  the  Gaussian 

case  -i  =  2  the  covariation  reduces  to  one-half  the  covariance. 

)( 

We  say  that  the  r.v.'s  Y^  and  Y2  in  M  are  mutually  orthogonal,  or  plain 
orthogonal,  if  [Y, ,Y„]  =  0  and  [Y0,Y,]  =  0.  When  [Y,  ,Y„]  =  0  we  say  that 
Y0  is  orthogonal  to  Yi ’  Y2  1  Yi  ’  ^us  a  nonsymmetri  c  notion  and 

coincides,  in  view  of  Proposition  1  (ii),  with  Y^  being  James-orthogonal  to 
Y ,  as  elements  in  any  Lf)(  ),  1- ps  ,  (see  Cambanis  et  al .  (1985))  for  a  discussion 
in  the  real  case).  While  independence  and  orthogonality  are  equivalent  in  the 
Gaussian  case  -  =  2 ,  when  ]'^2  independence  implies  mutual  orthogonality  but 
tne  converse  is  not  generally  true.  This  is  because  when  0:2,  Y^  and  Y^  are 
independent  if  and  only  if  their  representing  functions  f^  and  f^  have  disjoint 
supports,  i.e,  f ^  • f ^  -  0  a.e.  [..]  (famOanis  (1983)),  while  mutual  orthooonal i tv 
•merely  means  that  /f,f2'  1  d..  =  0  =  / f.,f-jl  1  da. 


We  now  show  that  just  as  in  the  real  case  regressions  on  one  r.v.  are 


linear. 


Proposition  2.  If  1  <  t<2  and  Y-j  ,Y^  ,  M  ,then 

[Yo ,  Y. ] 

E(YJY1)  =  •  1  '  Y 

6  1  TY  Y  1 

L  Wu 


Proof.  For  any  two  jointly  SuS  complex  r.v.'s  Y i , V2 »  it  is  shown  in  Cambanis 

(1983)  that  E(YJY,)  =  cY-j  iff  [Y2  -  cY1  ,  Re(zY1)]<  =  0  for  all  complex  z  in 

which  case  c  =  [Y0 , Y, ]  / [ Y  ,Y,]  ,  i.e.  iff 
l  la  ]  la 


[Y1,Y1]  [Y2,  Re(zY1)]  i  =  [Y2,Y1]i  [ Y 1 ,  ReCzY-, )]  . 

v 

Now  let  Y-j,  Y2  *  M  be  represented  by  f-j  ,f2  ■  L Then  the  necessary  and 
sufficient  condition  becomes 


du 


if2(Re 


V 


<u~l : 


du  = 


jVl 


t-1  • 


du  •!  f-,  (Re  z  f^ 


-1: 


du , 


Now  from 

E  exp  i  Re  (z^  +  z 2 Y 2 ) )  =  expi  -  r  | f ^  +  z2f2  ‘d». 

r :  -i  ara  f.,i 

=  exp1"i |Z1 'fl !  +  Z2f2e  !  dp) 

-i  arg  f^ 

it  follows  that  (Y^Y^  is  also  represented  by  ( ,  f  ^  ;  ,  f2e  ).  Thus 

without  loss  of  generality  we  may  take  f-j  to  be  real,  whence  Re  (z  f  ^ )  =  (Re 
and  the  necessary  and  sufficient  condition  for  linear  regression  is  clearly 
satisfied. 

)( 

A  natural  way  of  defining  an  angle  between  r.v.'s  Y-j  and  Y2  in  M  when 
1  -  >•  2  is  as  follows.  We  define  a  complex  valued  cosine  of  the_ angle  of  Y^O 


(X 
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with  Y.^0  by 


cosa(Yi’Y2)  "  C 


»*Y1«»„  ’  ||YJ| 


]  = 


21  'u 


-  Wu _ 

llyiiL  -Y2-r 


By  Proposition  l(ii),  it  can  also  be  written  as 


EY,  Y 


p-l> 


C0Sa(W  = 


1  2 


<p-l> 


(E|Y1|p)1/p(E':Y2;h) 


p-1  =  E(  — 

P\P"  I  i  Y 


1  1  ‘  P 


, .v  <P-1 > i 


-)  = 


cosp(Y.]  ,Y2) 


for  all  l'p'  ..  Thus  the  cosine  defined  through  covariation  agrees  with  that 

defined  through  LP(  .)  for  a1!  1 <  p<  . .  Henceforth  we  will  simply  write  cos(Y^,Y2), 

instead  of  cos  (Y,  v  )  or  cos  (v  v  )_  When  either  Y.=n  or  Y  =0,  we  define 

r  1  2  p  1  2  1  2 

cos(Y-j  ,Y2)=0.  Clearly  | cos ( Y-j  ,Y2)  j  1  with  equality  only  when  Y^  =  zY^  for 
some  complex  z.  The  cosine  of  the  angle  cf  a  subspace  with  another  subspace 
f<2  of  MX  is  defined  by 

r( NrN2)  =  sup  t  ! cos  ( Y -j , Y 2 ) ) :  Y]cN],  Y^} 

and  thus  .  ( N ^ , N ^ )  <_  1.  Extending  an  idea  of  Nelson  and  Szego  (1960),  we  say  that 

and  are  at  positive  angle  if  p(Nj,N2)  <  1  or  equivalently  (as  we  will  see 

in  the  next  proposition)  b(N  N,)  -•  ]. 

2  !  )( 

The  distance  between  two  subspaces  and  of  M  is  denoted  by 
djNrN2)  =  infliiYrY2i!a‘Al:  Y]  .  Y2  ,  N?,  '  Y,  =1  =  '  Y?  !  : 

1  1 

or  by  dp(N-],N2)  =  inf  { ( E 1  Y-j -Y2 ; p)  P  :  Y^  .  ,  Y2  ■  N2  ,  0<p<«.  In  view  of 

Proposition  l.(i)  we  have  dp(N^  ,N2)  =  Const(p,-<)d  (N^  ,N2) .  We  say  that  N-j  and 
‘<2  are  at  positive  distance  and  write  d ( N , Np )  '■  0  if  d  (N^,N?)  0,  or  equivalently 

Y 

if  dp(Hi,N2)  •  0  for  some  0  p<i.  We  now  show  that  when  1>  i<2  two  subspaces  of  M 
are  at  positive  angle  if  and  only  if  they  are  at  positive  distance.  This  is  a 
crucial  property  needed  for  the  development  in  Section  4. 
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X 

Proposition  3.  Let  l'x<2  and  ,N^  be  two  subspaces  of  M  .  The  following  are 
equi valent. 

(i)  d(NrN2)  >  0. 

(ii)  o(NrN2)  <  1. 

(iii)  p(N2,N1  )  <  1 . 


Proof.  The  proof  of  (i)  >(ii)  (in  the  real  case)  was  shown  to  us  by  Jan 
Rosinski.  Since  (i)  is  symmetric  in  N-^N^,  it  suffices  to  show  (i)<  >(ii). 

Now  to  show  (ii)  >(i),  it  suffices  to  show  that  d(N^ ,N~)  =  0  implies 
.  (N,  ,N2)  =  1.  Assume  d(N^,N2)  =  0.  Then  there  exist  Yn<- N-|  >  znfN2’  such  that 


=  1  =  1 |Z  1 i  and  j |Y  -Zl 
'n't  1  ■  n  n 1 


[Y  -Z  ,Z  ]  |  <  |  Y  - Z  |  i 
L  n  n  n  -t '  -  '  1  n  nMa 


,rx-l 


n '  ’  u 


>  0.  By  Holder's  inequality 

It  follows  that  [Y  -Z  ,  Z  ] 
n  n  n  a 


0  and 


thus  [Y  ,  Z  ]  ■>  1,  i.e.  cos(Y  ,Z  )  ■+  1  and  p(N,  ,NJ  -  1. 

n  n  >  n  n  i  l 

We  now  show  (i)  >  ( i  i ) .  Assume  (i)  and  put  t.  =  d(N^,N2)  >  0.  Let 

be  the  subspaces  of  La(u)  which  represent  N^N^.  Then  (i)  implies  that  for 
all  f^  M1 ,  f2-M2  with  J j f ] | {  _  =  1  =  ! I f 2 1  I  . »  we  have  1 ' f q  ~f 2 i I  ,  1  c  >  °-  BY 
tne  uniform  convexity  of  Lx(,;)  (cf.  Kothe  (1969), 26.7])  there  is  ■  =  f(  ) 
such  that  Mf  +f  <  2(1 -a).  Thus  for  every  0<-  1  we  have 

"( i ;  f  2+:  f  i  i  I  '  ■  f  2  '  i  =  }(i!0-')V'(fi+f2)!|t‘‘if2li.) 

: V  :  , 


=  I  If  +f  M  -  1  1 f  I 
*  T1  2'  .  '  2 


1  f , +f„ : ■  -l  -  i-2a 

I  L  i 


On  the  other  hand,  as  in  the  proof  of  Proposition  l.(ii),  we  have 

d  l  I  e  .  -  r  I  !  _  n.  !r  r' 


dT  iiY'-VLa^o  ■ Re  Ih'i . 


I 
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It  follows  that 

Re  (  <  1-2«S. 

j  1  2 

Since  this  is  true  for  every  f^  f  with  |  !  fj!  |  ^  =  1,  replacing  f^  bv 

f  <•«_!> 

f-j  exp, -  i  arg  ( i f i f 2  dw);  we  obtain 

1  |  f1f5°t_1  >dp  i  <  1-2.-,. 

)  *- 

It  follows  that  for  all  e  c  with  I ! | !a=l= I ! ! Ia  we  have 

[Y^  ,Yp]  !  c.  1-2c  and  hence  p^N^N^)  <  1 -2S  •'  1. 

X  X 

Now  fix  a  subspace  N  of  M  and  an  element  Y<_M  \N.  In  the  Gaussian  case 
.=2,  the  projection  P(YjN)  of  Y  onto  N  is  the  element  of  N  which  is  characterized 
by  the  orthogonal i ty  of  Y-P(YjN)  and  N,  which  in  this  case  (  <~2)  is  equivalent 
to  either  of  the  following: 

[n,  Y-P(Y  |N)],t=  0,  for  all  n^N, 

[n,Y]a  =  [n,P(Y|N)]r<,  for  all  neN, 

[Y,n]  =  [P(Y|N),n]  ,  for  all  neN, 

[Y-P(Y;N),n]  =  0,  for  all  ncN. 

When  l-.<2  however,  since  the  covariation  is  neither  syimnetric  nor  linear 
in  its  second  argument,  only  the  last  two  conditions  are  generally  equivalent, 
and  in  general  the  first  three  conditions  are  distinct.  Thus  when  Vf'2 
there  are  three  possible  ways  of  defining  projection,  via  the  first  three 
conditions  above.  The  first  condition  leads  to  the  metric  projection  m(Y'N), 
which  is  the  unique  element  in  N  minimizing  the  distance  to  Y  from  N,  in  any  of 
the  applicable  metrics  discussed  above,  for  instance 

' 'Y-n(Y'M) ||  =  inf  1 |Y-p|  \  , 

a  n.N 
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and  is  uniquely  determined  by 

[n,  Y-m(Y[N)]t  =  0  for  all  ntN, 

(cf.  Singer  (1970a)).  Using  the  second  and  third  conditions  we  define  the  left,  resp. 
right,  angle  projection  of  Y  onto  N  as  an  element  a^,(Y;N),  resp.  a  (Y;N),  of  N 
which  satisfies 

[n,Y]  -  [n,  a,,(Y[N)]  for  all  n,;N, 

rt  i  il 

resp. 

[Y,n]^  =  [ar(Y ' N) ,n] ^  for  all  ncN. 

The  following  properties  further  justify  the  terminology  used. 


Proposition  4.  If  a.(Y'N),  resp.  a  (YjN),  exists  then  ;|a,(Y',N)|l  <  ''Y'! 

resp.  ar(Y  N) '  ^  |jYj|^,  and  i f  moreover  a ^ ( Y | N)  f  0,  resp.  a ^ ( Y i N )  f  0, 

then  the  left,  resp.  right,  angle  projection  direction  minimizes  the  left. 


resp.  right,  angle,  i.e. 

a* (YjN) 

sup  ,cos(n,Y)  I  =  jcos( - ,  Y)  j 

n  N  !|a(,(Y;N)|! 

n  =1 

.  X 
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characterize  their  direction. 

X  X 

Proposition  5.  Let  N  be  a  subspace  of  M  and  Y  c  M  \N.  The  left  angle  projec 
tion  a,(Y  N)  exists  and  is  unique,  and  if  it  is  not  zero,  the  left  angle 
projection  direction  S,(Y|N)  =  a^,(Y|N)  j  |a .(Y '  N)  !  j is  characterized  as  the 
element  of  N  which  satisfies 

[  n-[n,S£(YjN)]a^(YjN)  ,  Y  ].  =  0  for  all  n,N. 

Proof.  If  for  all  n*  N,  [n,Y]^  =  0  then  it  follows  that  a^(Y'N)  =  0  uniquely. 
We  therefore  assume  that  [n,Y]  does  not  vanish  for  all  n>  N.  We  will  show 

<x 

that  there  is  a  unique  left  angle  projection  direction  '^.(Y!N)  in  N  with  unit 
norm  (written  for  simplicity  >■  ) : 

sup  icos  (n,Y)  j  =  , cos ( •  ,Y) 1 , 
n-  N  * 

:  y  !  ,=1 

(where  we  may  in  fact  delete  the  absolute  value  on  the  right  hand  side)  and 

that  it  is  characterized  as  stated.  It  will  then  follow  immediately  from  the 

characterization  of  ■  ,  that 

( 

,  J  .. 

af(Y.N>  =  [  f,Y]  -T  ■  . 

satisfies  for  all  n.  N,  [n,a  -,(Y  M)]  =  [  , Y ]  [n,x„]  =  [n,Y],  hence  it  is  a  left 

i  i  (  i  ( 

angle  projection  of  Y  onto  N,  and  its  uniqueness  follows  from  Proposition  4 
and  the  uniqueness  of  f(.. 

Let  f  ■  L‘(„)  and  the  subspace  M  of  L  1  {■.-,)  represent  Y  and  N,  and  let  g 
represent  n- N  with  j  ’  n  |  1  =1.  We  have  cos(n,Y)  =  /gf'  di.  •  i  \  f !  !  ^ ”u  ,  and 

•  *  l 

thus  to  show  the  existence  and  uniqueness  of  ■■  it  is  equivalent  to  show  that 
there  is  a  unique  g„  •  M  with  ! !g  ;  -1  such  that 
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S  =  sup  {  Mgf  g-  M,  !|gj;  =!'  =  ‘  q  .f  ’  1  du ;  . 

J  1  )  "  * 

There  exists  a  sequence  g  ?H,  ||g  ||  =1,  such  that  :.'g  f  ’  ^'d..1  -  S.  Since 

n  n  a  n 

the  unit  sphere  in  Ll(u)  is  weakly  compact,  there  is  a  subsequence  fg 

nk 

converging  weakly  to  some  g  :  /  g  f  l~  do  <•  f‘  ^d.  ,  so  that 

nk 

S  =  !.‘g  f<'l”^>di.  .  Also,  since  weak  limits  from  M  belonq  to  M,  as  M  is  a 

subspace  of  the  reflexive  Banach  space  L‘(. .),  we  have  qo<M.  As  it  is  clear 
that  g  =1,  existence  of  g(,  is  established.  To  show  its  uniqueness, 

assume  there  are  two  distinct  directions  s p \ g ^  1  and  spigot  with  g.j  ,g2- M  and 
;  =  1  =  Mg  j  j  ,  such  that  j/g^f  d-.i|  =  S  =  j/g^f  '"^du!.  Then 
h.  =  g^exp  f-i  arg(."g.f<‘i”"'>d,i)T,  i  =  1 , 2 ,  belong  to  M,  have  unit  norms  and 
satisfy  ,‘h.f  ‘"^du  =  S,  so  that 


1  |(h1+h2)f<,t_1>dp  =  S. 


Since  sp  {g^  ;■  f  sp  \g^},  we  have  h^h^  and  putting  1  h  ^  -  h^  !  (  =  c  >  0,  by  the 
strong  convexity  of  Ll(,.),  there  is  6  =  '•(>  )  ■  0  such  that  |;h^+h2’j,  <  2(1-'.). 
It  follows  that  h  =  (h^+h2)|'h^  +  h^ | ’  ^  belongs  to  M,  has  unit  norm,  and 
satisfies 


hf 


) 


| ^ hi  +  h2 ) f 


>  S 


contradicting  the  definition  of  the  supremum  S.  Hence  the  uniqueness  of  g, 
is  establ ished. 

The  unique  maximizing  element  g  must  satisfy  (d/dt  )F(g{.  +  cg)^  _q  for  all 
q  M,  where 

F  ( q )  =  f  qf  a_1  d;:  +  ‘(  '  q !  ‘d(.  -  1  )  , 

) 

(see  Luenberger  (1969),  pp.  188-189)  i.e.  'gf  '  ^  d.i+  ■  i.'go  1  '  do  =  0, 

cy  M.  Putting  g=g(, ,  we  find  '  .  =  - .'g^, f  ’  ^  'd.,,  and  thus  the  condition  becomes 
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'  ,<c«-l>  . 

gf  d-  -  gg^ 

j  i  l 


<  '  dp  '■  g^f  u  ^'d,.  =  0  for  all  g.M. 


Expressing  it  in  terms  of  the  space  M  ,  this  condition  becomes 


[n,Y]  -[n,v,]  [i,.,Y]  =0  for  all  ncN.  Hence  the  proof  is  complete. 

~i.  t  Cl  c  ■  t 


In  studying  right  angle  projections  we  will  use  the  following  characteri¬ 
zation  of  linearity  of  regression,  which  is  a  complex  version  of  a  result  in 
Cambanis  et  a  1 . ( 1 985 ) . 

Proposition  6.  Let  N  be  a  subspace  of  and  Y=-MX  N.  Then  E(Y!N)-N  if  and  only 
if  there  exists  Y  •  N  such  that  [Y-  Y,Z].=0  for  all  1  N  and  then  Y  =  E(Y'N). 


Proof.  Let  Y  =  Y-j  +  iY^,  ^  =  Z-j  +  iZ^  be  represented  by  f,g  respectively  and  put 
:  (r-j  ,r^)  =E  exp{i  Re(rY  +  Z)1  =  E  expM  (r-)Y-1  +  r2Y2  +  Z-j )  1 


Ihen 


E  e1Re(Z)V: 


exp  t-jjrf  +  g  |  ld,. ; 


-i(£r  +  ivir-) 

drl  3r2  r-|=0=r2 


:i>  exp(-/jgj  ld..)  { /;  g !  ’  2Re(gf)d..+i/ig;  '  2Re(-igf)d. 


=  i  i  exp(-/|  g *d. . )  •  /fa  1  ^  d.i 
=  i  i  exp  (-|  \1,  ia).  [Y ,Z] 

i 


■cf.  proof  of  (ii)  of  Proposition  1).  It  follows  that 
E-  e1  Re^Z^[E(Y  ,fJ)-Y]}  =  E  e1  Re(Z)(Y-Y) 

=  i-  exp(- ' ; Z 1 1  ')  •  [ Y - Y ,Z]  . 

i  A  1 
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Now  E(Y'N)-N  iff  for  some  Y< N  we  have  E(Y|N)  =  Y  or  equivalently  LHS  =  0 
for  all  Z  N,  i.e.  RHS  =  0  for  all  Z<N. 

We  now  show  that  right  angle  projection  does  not  always  exist,  that  it 
is  unique  whenever  it  exists  ,  and  that  it  coincides  with  conditional  expec¬ 
tation  whenever  the  latter  is  linear.  Recall  that  in  the  Gaussian  case  t=2 , 
conditional  expectations  are  always  linear  and  coincide  with  the  metric  and 
both  angle  projections. 

X  X 

Proposition  7.  Let  N  be  a  subspace  of  M  and  Y<M  N,  and  l<t<2. 

(i)  The  right  angle  projection  of  Y  onto  N  may  not  exist  in  general. 

(ii)  If  the  right  angle  projection  exists,  then  it  is  unique. 

(iii)  If  the  conditional  expectation  E(Y]N)  is  linear,  then  the  right  angle 
projection  exists  and  they  are  equal:  a  ( Y  J  N )  =  E(Y|N). 

Proof,  (i)  The  right  angle  projection  fails  to  exist  even  in  the  real  case. 


Here  is  an  example.  Take  I  =  [0,1],  u  =  Lebesgue,  f,  =  1, 


nere  is  cm  excunpie.  idK.e  i  -  J,  u  -  Leutrsyue,  i-j  -  i  j-  q  2/3]’  ^2  =  ^  [  1  /  3  ]  ] 

f  =  Ij-q  Y  =  /fdZ,  Y.  =  /f-dZ,  i  =  1 , 2 ,  N  -  sp'Y^Y^  .  If  ar  exists  it  must 
be  of  the  form  a^  =  aY-j  +  bY^  =  /( af 1  +  bf^)dZ  for  some  a,b;  and  it  must 
satisfy  [Y,n]  =  [a^,n]  for  all  n.  N,  i.e.  for  all  n  -  xY^  +  yY^  =  /( xf ^  +  yf^)dZ. 

Thus  a,b  must  satisfy 


fl  •  1  f1  is 

(af,  +  bf?) ( xf -j  +  yf?)  1  =  '  ( x f ,  +  yf?) 

1  2  I  2  iQ  l  2 


for  all  x ,y . 


Putting  x=0  and  y=0  gives  a=b=2/3,  and  then  putting  x=y  gives  the  contradiction 
2  =4.  A  genuinely  complex  isotropic  example  can  be  provided  by  takinq 
I  =  ..  =  Lebesgue,  Y^  =  /_^e‘i  k  dZ(  ) ,  k=0 ,1,2,  N  =  sp  Y^Y^;, 

Y  =  yo+Y1+Y2’  anCi  reac*1^n1  a  contradiction  likewise  (using  a  property  shown 
in  Example  4.5  in  Cambanis  et  al.  (1985)). 
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(ii)  Suppose  there  are  a.|,a2'N  such  that  for  all  n-  M :  [Y,n]  =  [ a , n ] 

and  [Y,n]  =  [a„,nl  Then  [a,,n]  =  [a0,n]  and  [a,-a0,n]  =0  for  all  n.  N. 

t  4  (X  I  t  4  t  1  4  l 

Taking  n=a-j-a2  gives  :  ! a  -j  -  a  ^  I  ! ' A  =  0  and  thus  a^a^. 

(iii)  If  £ ( Y | N ) • N ,  by  Proposition  6  we  have  for  all  n-N,  [Y-E(Y'N),n]  =0, 

i.e.  [Y,n]  =[E(Y  N),n]  ,  and  thus  by  (ii),  ajY'N)  =  E(Y.N). 

x  .  t  r 

The  following  examples  show  that  in  the  non-Gaussian  stable  case  1-  r  2, 
the  metric  projection,  the  left  angle  projection,  and  the  right  angle  projection 
may  all  be  distinct,  and  even  have  distinct  directions. 

Example  J:  Where  the  metric,  left  angle,  and  right  angle  projections  have  the 

same  direction  but  are  distinct.  Take  1  =  [0,1],  =  Lebesgue,  l<a-2, 

Y  =  .'1^„  w  =  •'rl(o  i)d2,  N  =  sP(Wi-  It  is  easily  seen  that 

1 

ar(Y  W)  =  E(Y,W)  -  3W,  a^(YlW)  =  (3)  1-1  W,  m(Y’W)  =  -  -  -- - — j  W, 

1  +  2,‘‘"1 

and  hence  they  are  all  distinct. 

Exampje  2.  Where  the  metric,  left  an d_  right  projections  have  distinct  directions 
Take  I  =  [0,1],  =  Lebesgue,  l-  t-2,  Y^  =  /  1,q  ^^dZ,  Y^  =  l)d^’ 

\  =  sp  Y.|,Y2;  and  Y  =  /l^  3 ) dZ .  An  easy  calculation  shows  that 


ar(Y  Y1  ,Y2)  =  E(Y;Y1  ,Y2)  -  Y]  +  ^ 

1 

a  (Y  YrY2)  =  Y]  +  Y2, 


m(Y.Y1,Y2)  =  Y1  + 


—  v 
1  T2’ 


and  that  they  have  distinct  directions  (i.e.  coefficients  of  Y2). 

An  interesting  infinite  dimensional  case  where  all  projections  have  the 


same  direction  arises  when  X  =  iX^.,  t-  T  is  a  so-called  <-sub-Gauss ian  process 
1  n 

i.e.  X  =  A  Gt,  t-T,  where  G  =  ,  G^. ,  t-  T  r  is  a  zero-mean  Gaussian  process 

i  /2 

independent  of  the  positive  u/2-stable  r.v.  A, with  E  exp  (-uA)  =  exp  (-ul/  ), 
u>0. 

X 

Proposition  8.  Let  X  be  u-sub-Gauss ian  with  N  a  subspace  of  M  and 

YMX  N.  Then 

m(Y  N)  =  ar(Y  |N)  -  E(Y'N)  =c  a(,(Y  N) 


for  some  constant  c  (depending  on  Y  and  N). 


Proof.  We  have  MX  =  A  ^2*M^  and  thus  N  =  a'Y2L  for  some  subspace  L  of  M^, 


,1/2,., 


and  Y  =  A  W  for  some  W^L.  Also,  from  Corollary  2.3  in  Cambanis  and  Miller 
(1981), 


[Y,,YJ 


E(W,  W„)  2  i/p 

1  2  -  ,  j|Yj  ^  =  (±£W lYU. 


2  '  2’22[E wZ]’-a/2 


The  expression  of  the  norm  shows  that  m(Y!N)  =  A^2m(W;L)  =  A^Y2E(W’L).  The 


1  /  2 

expression  for  the  covariation  then  shows  that  for  all  n  =  A  t'-N,  t-L, 


n]  _  _E [ E ( W;_L ) <_] H[Wt_]  __  _  r y  ni 

L"{Y  N)’n].,  ‘  2:,/2[E(,2]1-h/2  21/2[e.2]1-:.72  "  [Y’n] 


so  that  ar(Y  N)  r  m(Y|N).  As  for  sub-Gaussian  processes  conditional  expectati 


are  linear  (cf.  Hardin  (1982a)),  we  have  by  Proposition  7 ( i i i ) ,  a  (Y  N)  =  E(Y 


/.e  also  see  that 

[n,m(Y  N)] 


E[ EE (W ; L ) j 

2fl/2[E:E(W.L)  I2]1"72 


-1 


EW  , 1  - </2  E( i W)  1 r  vi 

7  „  ,/2r,  ,2  -1  -  ,/2  •*  L  l,,'Y‘ 


E I E(W  ; L ) 


2  '  [EW 


j 


1 


from  which  it  follows  that  a,,(Y,N)  =  c  m(Y,N). 
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3 .  Regularity  and  orthogonal  moving  average  representation . 

In  this  section  we  obtain  criteria  for  regularity  of  harmonizable  S 
processes  X  =  X^i ,  and  a  Wold  decomposition.  We  first  present  and  discuss 
the  results,  and  then  prove  them. 

A  process  is  called  regular  when  its  remote  past  is  empty  and  singular 

wnen  its  remote  past  contains  all  the  (linear)  information.  Specifically,  let 
X  X 

us  denote  by  M  ,  resp.  M  ,  the  closure  in  probability,  or  in 

n  "i 

norm  or  in  L  (i-)  norm  (cf.  Proposition  1),  of  the  linear  span  of  { X.  ,  k  n-, 

P  K  — 

X  X 

resp.  X. ,  k'  +"  ; .  The  remote  past  of  X  is  the  subspace  M  =  M1  .  X  is 
k  r  K  -*  n  n 

X  XX’ 

called  regular  if  M  =  and  singular  if  M  o  =  M  .  H  1  denotes  the  space  of 

Hardy  functions  in  the  unit  disk.  Spectral  and  time  domain  criteria  for  regularity 
are  given  in  the  following 

Theorem  1 .  For  a  harmonizable  SaS  process  X  with  ]■' ,<2  and  spectral  measure 
the  following  are  equivalent. 

(1)  X  is  regular. 

(2)  d..(  -)  =  f (  ■  )d“  and  /  ..log  f(')  dr.  >  . 

(3)  d.  (  •)  =  f(  )  d  and  f(  )  =  !t(  ),  1  where  C  r  Hu. 

(4)  X  has  a  moving  average  representation  X  =/^_q  akVn  k,  where  the  process 

X  V 

V  =  -V  ■  is  jointly  stationary  with  X,  satisfies  M  =  M  ,  and  has  mutually 
n  n  n  J 

orthogonal  r.v.  ’s. 

(5)  The  one  step  ahead  linear  predictor  X  ,,  of  X  ,,  based  on  i  X.  ,  k<n ;  is 

n+ 1 ,n  n+ 1  k 

given  by  X  ,,  =  >.  .  a,  V  .  ,  where  the  process  V  =  V  )  is  jointly 

n+l,n  k=l  k  n+l-k  n  J 

X  V 

stationary  with  X,  satisfies  =  M  ,  and  has  mutually  orthogonal  r.v.'s. 

Tnese  criteria  extend  to  the  case  1  .-  2  the  well  known  criteria  for 
regularity  in  the  Gaussian  case  i=2.  While  the  spectral  domain  criteria  (2) 
and  (3)  are  nearly  identical  to  those  in  the  Gaussian  case,  the  time  domain 
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criteria  (4)  and  (5)  exhibit  significant  differences  with  tneir  Gaussian 
counterparts.  The  series  in  (4)  and  (5)  converge  in  •  norm,  or  equiva¬ 
lently  in  p-th  order  mean  0-  P' 

The  spectral  domain  criterion  (2)  was  established  in  Cambanis  and 
Soltani  (1984)  and  has  the  feature  of  being  independent  of  the  index  of 
stability  The  spectral  density  factorization  criterion  (3)  does  depend 
on  : ,  does  not  require  ;  to  be  outer,  even  though  this  may  be  added  to  it 
without  loss  of  generality,  and  leads  to  the  following 

C_orqjJary  1.  If  0<f-  l\  then  f  is  factorable  as  f  =  [c  |  with  ;  Hl,  if  and 
only  i f  log  f  .  . 

The  time  domain  criterion  (4)  provides  a  "unique"  orthogonal  moving 
average  representation  in  terms  of  a  S «S  process  V.  As  shown  in  the  proof  of 
Theorem  1,  the  S <S  process  V  is  in  fact  harmonizable  with  lebesgue  spectral 
measure,  and  up  to  a  fixed  multiple  the  weights  ■  a  ^  •  in  the  moving  averaoe  are 
the  Fourier  coefficients  of  the  outer  factor  :  of  the  spectral  density  f.  The 
necessity  of  the  moving  average  representation  (4)  is  a  refinement  in  the  discrete 
time  case  of  a  continuous-time  result  in  Cambanis  and  Soltani  (1984)  (Theorem  3.1). 
In  sharp  contrast  with  the  Gaussian  case  where  the  r.v.'s  of  V  are  independent, 
in  the  non-Gaussian  stable  case  the  process  V  never  has  independent  r.v.'s;  this 
is  the  discrete-time  analog  of  a  continuous-time  result  in  Theorem  3.1  of  Cambanis 
and  Soltani  (1984).  Thus  the  moving  average  obtained  nere  is  the  best  extension 
to  stationary  harmonizable  stable  processe-.  of  the  result  for  stationary 
Gaussian  processes.  More  specif icall  ,  we  cun  prove  the  following 

Proposition  9.  (i)  A  han-onizdOle  v  ‘  :*ro<  ess  *,  with  1  ■  .  2  is  regular  if  and 

only  if  it  nas  a  moving  average  represent. :t  ion  X  =  '■  a.V  ,  where  a^'-0 
J  J  n  k L~0  k  n-k  U 
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and  V  =  is  jointly  stationary  with  X,  satisfies  !*T=tV  ,  and  has  mutually 

orthogonal  r.v.'s  with  norm  one. 


(ii)  The  representati on  in  (i)  is  unique. 

(iii)  Mo  harmonizable  non-Gauss i an  S <S  process  X  with  O'  .r2  is  the  moving 

X  V 

average  of  an  independent  S <S  process  V  with  M  =  M  . 

The  time  domain  criterion  (5)  expresses  the  one  step  ahead  linear  predictor 
as  the  one  term  truncation  of  the  moving  average.  Its  necessity  is  implicit 
in  Hosoya  (1982)  and  Cambanis  and  Soltani  (1984).  In  sharp  contrast  with  the 
Gaussian  case,  however,  in  the  non-Gaussian  stable  case  the  m-term  truncation  of 


the  moving  average  does  not  generally  produce  the  m-step  ahead  linear  predictor 
for  mv2.  The  linear  predictor  Xn+m  n  of  X  based  on  f Xk ,  k-  n'  is  the  best 

Y 

metric  approx imation  to  X  ,  in  H  : 

n+m  n 


n+m 


X  A  i 
n+m,n 1 


i  i 


=  inf 


n+m 


or  equivalently,  by  Proposition  1, 


E  .  X  -  X  :p  =  inf  I  E ;  X  x  -  Y  p:  Y-  ,  0-  p  ., 
n-t-m  n+m,n  1  n+m.  n  ’  ’ 


and  is  uniquely  determined  by 


[X, ,  X  ,  -  X  ,  ]  -  0  for  all  k  n. 

L  k  n+m  n+m,n  t 


cf.  Singer  (1970a).  In  particular,  the  m-step  ahead  linear  predictor  is  given 

by  the  m-term  truncated  moving  average:  X  ,  -  7,  a, V  ,  if  ana  only  if 

n+m,n  /  k=m  k  n+m-k 


m-1 


[Vj'ki0akVn+m-kJ,  =  0  for  a11  J  '  "• 


X  V 

since  ^  ;  or  equivalently  if  and  only  if 


V'  ,  •  m- 1  . 

!  e  \l  a,  e1k  )  d  •  =  0  for  all  f 
k=0 


where  the  s  are  the  Fourier  coefficients  of  the  outer  factor  ;  of  the 
spectral  density  f. 

Putting  together  the  (clearly  unique)  decomposition  into  independent 
regular  and  singular  components  obtained  in  Cambanis  and  Soltani  (1984), 

Theorem  4.2  ,  along  with  Theorem  1  and  Proposition  9  we  have  the  following 

Theorem  2.  Wold  decomposition.  Let  {X^t  be  a  (non-singular)  harmonizable  SaS 

process  with  l<a<2.  Then  there  is  a  unique  4-variate  harmonizable  SaS  process 

•X  ,Y  ,Z  ,V  }  such  that 
n’  n’  n  n 

X  =  Y  +  Z  =  7  a.  V  ,  +  Z  , 
n  n  n  ^-q  k  n-k  n 

■  Y^ }  is  regular,  {Znl  is  singular  and  independent  of  (Y  }  and  of  { } ,  a-i-0, 

XX  V 

and  (V  }  are  orthogonal  and  satisfy  M  =  M  +  M 
n  3  n  ->'■  n 

Of  course  we  also  have  that  =  MZ  is  independent  of  MV  =  ,  and  Z n  is 

Y 

the  metric  projection  of  X  onto  M  . 

n  -,x> 

In  the  Gaussian  case  o=2  the  innovations  { Vn }  are  independent,  and  the 
m-step  ahead  linear  or  regression  predictors  are  obtained  by  m-term  truncation 
of  the  right  hand  side  of  the  Wold  decomposition.  In  the  non-Gaussian  stable 
case  the  Wold  decomposition  described  in  Theorem  2  has  substantially  weaker 
consequences  and  in  particular  provides  only  the  one  step  ahead  linear  predictors. 

For  general  SaS  processes  Wold  decompositions  with  stronger  properties,  called 
"right",  "left"  and  "independent"  Wold  decompositions,  are  defined  and 
studied  in  Cambanis  et  al.  (1985),  to  which  the  reader  is  referred  for  definitions  and 
details.  However  harmonizable  SaS  processes  can  not  have  any  of  these  stronger 
Wold  decompositions. 


Proposition  10.  A  harmonizable  SaS  process  does  not  have  a  right,  left  or 
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independent  Wold  decomposition. 

Proof  of  Theorem  1 .  The  equivalence  of  (1)  and  (2)  is  shown  in  Cambanis  and 
Soltani  (1984).  We  first  show  that  (2)  '(3)  (1). 

Assume  (2).  Then  <t>  can  be  defined  as  in  Cambanis  and  Soltani  (1934)  (Eq. 
(5.4)  or  Remark  5.1):  Since  log  ft  L1,  the  function 

f'11  oi0+- 

0(z)  =  exp  {—  I  -r~  log  f(")dB;,  z\  *'  1, 

'  ! -r  e  -z 

is  outer,  and  for  a.e.  0,  1  i mr^i  c(reiri)  =  £('•)  and  '[‘i1')' '  =  f(v)  (cf.  Rudin  (1966) 
Theorem  17.16). 

y 

Now  assume  (3).  Consider  the  linear  isometry  U,:  L  l(f)  ->•  M  defined  by 
U, ( f )  =  f  _fdZ,  which  is  onto  (cf.  Section  2).  Also  note  that  in  view  of  (3), 

A 

U2-‘  L‘(f)  -►  Lu(Leb)  =  La  defined  by  ( g )  =  go  is  a  linear  isometry  (which  is  not 
necessarily  onto).  Then  U  =  U^U-j  :  M  -  L  is  a  linear  isometry  (which  is  not 
necessarily  onto).  Since  U(Xn)  =  L^tU^X^]  =  ^(e-10  )  =  e~irUo(o),  we  have 
for  all  n, 

U(MX)  =  L‘‘  -  spie-1*0 ’v(O) ,  k  ^  n> 


=  LU 

-  sp{e1J,,f(i  ) , 

j  > 

-n ; 

C  La 

-  spfe1'-’  ,  j 

-n; 

(as 

,  a 

■— r  -iku  . 

=  L 

-  sp;e  ,  k  • 

nl . 

Tnus  MX  U_1[  I  -spie-^'  ,  k  <  n>],  and  in  order  to  show  (1):  MX  =  { 0 ) ,  it 
n  n  ■  n  ot  —  n  n 

suffices  to  show  ^L'-sp  le  1  ^  1 ,  k<n?  =  -0:.  Let  h  •  Lu-sp;e  "l^f\  k^n  •  for 
all  n.  Then 

I  h(o)e  ^'do  =  0  for  all  j  •  -n. 


Since  h  <-  La  c  L  and  all  its  Fourier  coefficients  are  zero,  h  =  0. 


We  now  show  (1)<^  >(4).  First  assume  (1).  Then  choose  an  outer  factor 

o  in  (3),  so  that  <i  ^  0  a.e.  It  follows  that  the  isometry  considered  in 

X  u 

the  previous  paragraph  is  onto,  and  hence  so  is  the  isometry  U :  M  -*■  L  .  Thus 
V  =  U'^(e"^nj)  are  well  defined  and  satisfy  M*  =  M^.  Since  t  <-  H 
it  has  a  Fourier  series 

co  . 

/  r  \  r  ,  ike 
t(6)  =  2,  V 
k=0 


which  converges  in  L c,  and  thus 


xn  =  U_1(e'inCd<'))  =  l  ,  .  I  »  v 


■1,  -i(n-k)e,  _ 


k=0 


k=0 


Also,  in  view  of  the  isomorphism  U,  we  have 

N  f  N 

E  exp  ii  Re  X  znvn>  =  exP  *-  I  I.zne  I  • 


n=l 


n=l 


Thus  V  -  •. V  f  is  harmonizable  SaS  with  Lebesgue  spectral  measure  and  thus 
mutually  orthogonal  r.v.'s: 

[V,  ,V  ]  =  f  e  ^  'e^n  d"  =  0  for  all  k  f  n. 

k  n  ct  j 


1  i  n  •  ■ 

inis  shows  (4).  The  joint  stationarity  of  X,V  is  evident  from  X  =U~  (e 

;n  - 

V  X  X 

Conversely  assume  (4).  Since  Mn  =  Mn,  each  Vn  belongs  to  M  and  is  thus 


of  the  form 


V  =  f  g  (o)dZ( ■■),  Rn  - 

n  )  _  -  n  n 


and 


Now  for  all  n,m  we  have 


Thus  for  each  m  the  Fourier  transforms  of  the  finite  measures  g  di>  and 
eimUg<o-l >d^  c0inci(jej  hence  these  measures  are  identical,  i.e. 
g<a-l>(0)  =  eimeg<a-l>(0)  =  (e-^g(o))<^l>  a.e.  [.],  and  thus 

gm(°)  =  e-imOg0(G)  a.e.  [,] 

(since  z  -  w  iff  z ^  =  w^’) .  From  the  orthogonality  of  the  V^'s  we  have 


0  =  =  f  9n9na~Udu  =  j  e'1nP  |gn  |adp,  n  f  0. 


n  0  a  j  yna0 

J 


It  follows  from  the  Riesz  theorem  that  the  measure  i gQ ( 0 ) ! ' 'd;i ( e )  is  absolutely 
continuous  with  respect  to  Lebesgue  measure:  |gQ(r’) |adp(e)  =  c(6)dr,  and  then 
the  above  equality  reduces  to  /"_e"iri0c(0)d0  =  0  for  all  n  f  0,  which  in  turn 
implies  that  c(G)  =  positive  constant  =  cu,  say,  a.e.  [Leb] .  Thus 

|g0(o)  |adp(f')  =  cado. 

X  V 

Note  that  M  equals  M  ,  which  is  isomorphic  under  the  stochastic  integral  to 

La(p)  -  spigk,  k<n}  =  (L  1  -  spfe“lk0,  k-_n  ; )  •  gQ , 

—  r  -  i  k  o 

which  is  in  turn  isomorphic  to  L  -  sp  te  ,  k^n;  under  the  correspondence 
h-g^  <  ch.  Thus  in  order  to  show  that  X  is  regular  it  is  equivalent  to  show 
that  nLu  -  sp  te'1  k,  k<_n;  =  {01,  which  has  been  done  in  the  third  paragraph 
of  this  proof.  Thus  (1)  is  shown. 


28 


We  finally  show  that  (4)  <  •  (5).  Assume  (4).  Put  Y  = 


a,  V 


'k=l 


k  n+l-k 


•  Then  Xn+1  -  Y  -  Vn+1  and  the  orthogonal  ity  of  the  V^'s  imply 

[Vk,  xn+]-y]i  "  0  for  all  kji,  and  by  linearity  and  continuity  [W,  X  ^  -  Y]  =0 
V  X 

for  all  W  •  Mn  =  M  ,  including  in  particular  all  X^'s  with  k  <  n.  It  follows 
that  Y  =  X 


n+1 ,n' 


Conversely  assume  (5).  Put  Wn+]  =  Xn+1  -  Xn+1^.  Then  [W ,Wn+1 ] 


for  all  W  <.  MX  =  M  .  Also  from  X  , ,  =  W  ,  +  J.  ,  a.  V  , ,  .  we  obtain 
n  n  n+1  n+1  £k=l  k  n+l-k 


XV  XV 

Mn+1  ~  Mn  +  s^Wn+l^’  and  ^r0m  Mn+1  =  Mn+1  a  stanc*arci  arqument 


MX,,  =  MV  +  sp(V  Hence  W  ,  <  MX  ,  can  be  written  in  the  form  W  ,,=Y+c V  . 

n  n+1  n+1  n+1  n+1  n+1 


n+1 


where  Y  t  MV,  and  thus  W  ,,-cV  x1  =  Y  <  M^.  It  then  follows  that 
n  n+i  n+l  n 


[W  -  cV  W  .,]  =0  and  [W  xl  -  cV  ,  V  xl ]  =  0 

L  n+1  n+1  n+lJa  n+1  n+1  n+1  a 


i  .e. 


W  a  =  c[V  , ,  W  •,  ]  and  CW,,,V.,]  =  c!  |V  I  !a 
■  n+1  a  n+1  n+1  a  n+1  n+1  a  1  n+1 1 'a  . 


Then  c  /  0.  For  if  c  =  0  -->  W  xl  =  0  >X  x1  =  X  x1  ,  MX  ■  >  MX  =  MX 

n+1  n+1  n+l,n  n  n+1  n 


-  N!^  ,  =  MV  >  [V  xl,V  .,]  =0  V  =0  >  X  =  0  i.e.  X  is  the  zero 

n+1  n  L  n+1  n+1  ot  n  n 


process.  Then  multiplying  the  above  equalities  together  we  obtain 

l  ft  i  1 1 1  i  I  o. 


[Vnti.  VlWl-Vlt  *  HVA  Writing  V„+1  •  /f^dZ 

and  Wn+^  =  ,‘g  ^dZ,  we  thus  have 


'  r  •  t-  1  >  .  .  I  r<Ol-l>.  f  |  r  |(t.  f  •  |  1, 

i  n+l^n+1  M  i^n+1  n+1  ^  J  n+1  ^  u  j'^n+l1 


Dropping  for  simplicity  the  subscripts,  this  means  that  equality  holds  in 


Holder's  inequalities  /; fj  J g d\j  <_  j|f|) 


/  g  f  <~1d.. 


I  1  v^t-1 

19:'  !'f|L  »  so  that  !g(o)i  =  r!f(o)!  a.e.  [u],  for  some  r'-O, 


and  thus  g(n)  -  re  f{  <)  a.e.  Substituting  in  the  above  equation  we 


obtain 


t  |  i  0  1  £  I  *  *  -I  B  /  f  ■  r  i  Ct  *  \2 

,  ;e  |f ,  dVi  1  =  (  J  If !  dp) 


and  an  elementary  argument  shows  that  e^ '  ^ is  a  complex  constant  for  a.e. 

w.r.t.  f  ‘d...  Thus  g  ^  ( fs )  =  zn+i f n+-| ( ” )  a.e.  [p]  for  some  complex  constant 

z  i ,  and  Wn+1  =  zn+]Vn+i-  The  joint  stationarity  of  X  and  V  implies 

[X  ,  -  X  ,  V  =  [W  ,  V„ . , ]  =  z  .  is  independent  of  n.  Hence 

L  n+i  n+l,n  n+1  i  n+1  n  +  la  n+1 

putting  z^+1  =  aQ  we  obtain  Xn+1  =  )'k=oakVn+l -k‘  TbuS  ^  is  establisbed  and 
the  proof  of  the  theorem  is  complete. 

Proojf  of  Proposition  9.  (i)  and  (ii).  Assume  (1)  of  Theorem  1  and  consider 

two  moving  average  representations  as  in  (4):  Xn  =  Z.|<=oapVn_h  ~  ‘k=Obk^n-k" 

Since  the  metric  projection  X^  ,  =  >  a  V  ,  =  T  b  U  ,  of  X  onto 

n,n-l  n  n-k  ,  k  n-k  n 


i  $  1 1  I  i  _■!  M  T 1  In  .  n  II 

X  v  u 

M  =  M"  =  M  is  unique  we  obtain  a^V  =  bAU  .  By  absorbing  in  V  ,  resp.  U  , 
nnn  Unun  n  n 


the  phase  of  aQ,  resp.  bQ,  we  may  assume  without  loss  of  generality  that 

a~,  bn  0.  Since  V  j  =  1  =  1 'ill  II,  it  follows  that  :a„;  =  i  b„ 1  and  hence 
u  0  n  n  u  U 

a,-,  =  bn.  Thus  we  have  V  =  U  for  all  n  and  hence  ,  ,  (a  -b  )V.  =0  which 
00  nn  k-lvnn  k 

implies  an=bn  by  the  orthogonality  of  the  V^'s.  This  shows  both  (i)  and  (ii) 


(iii).  Suppose  on  the  contrary  that  Xn  =  ^  wbere  the  r.v.'s 

•  V  ■  are  independent.  Since  Vn  •  M  ,  they  are  of  the  form  V ^  =  /'  fp ( *• ) dZ (  •) 

■  L‘([),  and  the  mutual  independence  of  the  Vn's  implies  the  f n 1 s  have 
mutually  disjoint  supports,  say  E  ,  (see  Cambanis  (1983)  for  the  complex  case 


considered  here).  It  then  follows  from  X 


dZ(n)  that  for  all  n. 


L akfn-k<  >  inL"(..). 
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r 


i 


i 


Ihus  for  all  k  _>  0  and  all  n,  on  En_k:  e 


-in 


akfn.k(' 0  a-e-  [m],  or,  equiva¬ 


lently. 


on  each  E  :  e~^n  +  J^  =  a.f  (  )  a.e.  j  _i  0. 


If  all  f  =0  then  all  V  =0  and  X  0.  Thus  for  some  m,  fc  ;f  ■  dj;  >0.  It 

in  a.  t  m 

m 

follows  from  the  displayed  equality  that  then  a.  1  0,  j  •  0,  which  in  turn 

3 

implies  V  f  ‘d..  •  0  for  all  in.  Now  fix  an  arbitrary  in,  and  some  c-  •  E 
’  E  rn  m 

witn  an  E..  nei ghbournood  of  positive  ..  measure.  Then  f m ( " )  =  e  for 

all  j  0,  implies  a^  r  e  lj  a^  for  all  j  0.  But  since  this  should  hold  for 
eacn  suer;  on  each  of  the  disjoint  sets  E  ,  it  leads  to  an  obvious  contradiction. 


ThuS  (iii)  is  proven. 


Proof  of  Proposition  10.  An  independent  Wold  decomposition  (WD)  is  precluded 
by  Theorem  2.  Assume  now  X  has  a  left  WD:  xn  =  +  Z'  a'V'_k  +  Z', 

along  with  the  WD  described  in  Theorem  2.  Then  is  the  metric  projection  of 

X  onto  (Cambanis  et  al.  (1985))  hence  Z*  =  Z  and  thus  also  Y'  =  V  .  It 

n  -  ■  v  n  n  n  n 


follows  that  =  MY 
n  n 


MY  =  and  thus  V  has  a  left  WD,  since  V'  does, 
n  n 


Similarly  assuming  X  has  a  righ  WD  it  follows  that  so  does  V.  But  it  has  been 
proven  in  Example  4  of  Cambanis  et  a1.(1985),  that  a  harmonizable  SuS  process 
with  Lebesgue  spectral  r.cusure,  such  as  V  of  Theorems  1  and  2,  has  no  left  nor 
right  WD.  Tnus  the  proof  of  the  Proposition  is  complete. 


In  this  section  we  give  spectral  and  analytic  criteria  for  a  harmonizable 
SotS  process  X  =  { Xn }  to  have  positive  angle  or  distance  between  past  and  future, 
and  we  discuss  its  ramifications. 

In  view  of  stationari ty ,  the  location  of  the  "present"  is  not  important, 

X  X 

and  thus  the  past  P  and  future  F  of  X  are  defined  as  the  closure  in  probability 

of  the  linear  spans  of  (X  ,  n  <_  0}  and  of  {Xn>  n  >_  1 }  respectively.  We  say 

that  past  and  future  of  X  are  at  positive  angle,  or  that  X  has  positive  angle, 

if  p(PX,FX)  <  1  or  p(FX,PX)  <1.  We  also  say  that  past  and  future  are  at 

positive  distance,  or  that  X  has  positive  distance,  if  d(P  ,F  )  >  0.  Finally 

X  is  called  minimal  if  X  cannot  be  perfectly  interpolated  from  { X. ,  k^n;,  i.e. 

n  k 

if  X^  does  not  belong  to  the  closure  in  probability  of  the  linear  span  of 
(Xk,  k/n}. 

Theorem  3.  For  a  harmonizable  SaS  process  X  =  {Xn)  with  l<a^2  and  spectral 
measure  u  the  following  are  equivalent  and  imply  that  X  is  regular  and 
mi  ni  mal . 

(1)  X  has  positive  angle:  p(PX,FX)  <  1  or  r(FX,PX)  <  1. 

(2)  X  has  positive  distance:  d(PX,FX)  >  0. 

(3)  iX  1  is  a  Schauder  basis  for  M  . 

(4)  d..(9)  =  f(i>)d0,  La(f)  >  iJ  ,  and  the  Fourier  series  of  every  g  r  Ll(f) 
converges  to  g  in  La(f). 

(5)  du(C-)  =  f(6)dr  and  the  spectral  density  f  satisfies 

(A  )  (4r  /  f(-!)co)(rrr  do)01”1  -  k 

'  1  I  * 1 '  I  ~ 

for  some  constant  k  and  all  intervals  I  with  length  |Ij  (which  are 
allowed  to  wrap  around  +n). 


(6)  Tne  conjugation  operator,  considered  cn  real  trigonometric  polynomials, 
is  bounded  in  L  . 

The  first  three  equivalent  conditions  are  time  domain  conditions,  while 
the  last  three  are  frequency  domain  conditions.  The  equivalence  of  the 
spectral  conditions  (4), (5)  and  of  (6)  with  ,j  absolutely  continuous,  is  a 
well  knowr  result  in  Hunt  et  a L ( 1 973 ) .  Here  we  provide  a  simple  proof  of  the 
equivalence  of  the  weaker  condition  (6)  (where  p  is  not  assumed  absolutely 
continuous)  with  (4)  via  the  time  domain  criterion  given  in  Corollary  2,  while 
of  course  the  proof  in  Hunt  et  al .  (1973)  is  analytic.  Let  us  recall  that 
the  conjugate  of  a  Fourier  series  V^a^e10'  is  defined  by  7  ,Q-i  sgn(n)a^e1n  . 

In  the  proof  of  Theorem  3  use  will  be  made  of  tne  following  property 
which  is  valid  in  general  normed  linear  spaces  and  says  that  two  subspaces 
are  at  a  positive  distance  if  and  only  if  the  algebraic  projection  from 
their  algebraic  sum  onto  either  subspace  is  a  bounded  operator. 

Prop_os_i  tion  11.  If  M  and  N  are  subspaces  of  a  normed  linear  space,  the 
following  are  equivalent. 

(i )  d ( M , h )  =  inf  •  jX-Y  |  ‘  |Xj  |  =  1  =  1  ;Y!  j  ,  Xr M,  Y.N;  >  0. 

(i i )  There  i s  a  constant  k,  such  that  j  |  X ,  ;  £  k '  X+Y  j  i  for  all  X. M,  Y. N. 

Proof,  (ii)  clearly  implies  (i),  with  the  inf  ■  k  \  We  now  show  that 

"not  (ii)"  implies  "not  (i)".  Assume  (ii)  is  not  satisfied.  Then  there  are 

a  M,  Y  •  N  such  tnat  0  •  n  j  1 X  -Y  ;  I  •-  1  X  ,  .  It  follows  that  Y  0  for 
n  n  n  n  n  n 
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.  iivui , 

-  1 ! xn  1 1 


MXnll 


i ix  :: 

ii  n  i 


Vp 

ru r 


I  iX  -Y 

i  >  n  n  • 


ir° 


and  hence  (i)  is  also  not  satisfied. 


We  now  obtain  the  following  useful  result. 

Corollary  2.  With  X  as  in  Theorem  3  the  following  are  equivalent. 

(i)  X  has  positive  distance:  d(P*,FX)  >  0. 

(ii)  There  is  a  constant  k  such  that 

m'  m 

ilrJ.k-C"XnlC-k|l„Ll>X"li“ 

for  all  0<k"<k,  0<nT<m,  and  complex  numbers  c  (and  we  may  take  k  =0  or  m  =0) 

~  —  —  -  n 

(iii)  Tnere  is  a  constant  k  such  that 

m'  m 

1 1  i  c  x  1 1  <  k  i  j  y  c  x  i ; 

n=k'  n  n  a"  n=k  n  n  a 


for  al  1  k<k'<m'<m. 


Proof.  The  equivalence  of  (i)  and  (ii)  is  an  immediate  consequence  of 
Proposition  11,  and  the  equivalence  of  (ii)  and  (iii)  follows  from  the 
stationarity  of  X. 

Proof  of  Theorem  3.  The  equivalence  of  (1)  and  (2)  is  shown  in  Proposition  3. 
The  equivalence  of  (2)  and  (3)  follows  from  Corollary  2  and  the  fact  that 
(iii)  in  Corollary  2  is  a  characterization  of  a  two-sided  Schauder  basis, 
cf.  Singer  (1970). 
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We  next  show  that  (3)  implies  that  X  is  regular  and  minima'’.  An 
argument  similar  to  the  one  below  has  been  used  in  Miamee  and  Niemi  (1985). 
Assume  (3).  To  show  that  X  is  minimal:  Xn  k  sp  {X^,  k  f  n1,  it  suffices  to 

_  Y  _  V 

show  that  sp  { X ^ ,  k  f  n}  ^  M  .  Assume  on  the  contrary  that  sp  { X k ,  Mn;=  M 

_  Y 

for  some  n,  and  hence  by  stationarity  for  all  n,  so  that  sp  { X k ,  k^n  •  =  M  . 

In  fact  we  will  show  that  n  sp  ;X^,  k^n  '■  =  { 0 > ,  namely  that  X  is  Jg-regular. 

Indeed  if  V  ■  sTp  {X^,  k^n}  then  by  (3)  it  can  be  written  uniquely  as 

Y  =  -  c  Y  ,  and  since  for  each  n,  Y  <-  sp  { X .  ,  k/n }  we  have  c  =  0  and  thus  Y=0 

n  n  n  k  n 

Hence  X  is  Jg-regular,  and  thus  minimal  as  well  as  regular,  since 
n  sp  \Xk,  k_n:  c  ,  ^  sp"  {Xk,  k^nj  =  {01. 

Now  we  show  (3)  <-■ ■■>  (4).  First  assume  (3).  Then  X  is  regular  and 
by  Theorem  1,  we  have  dp(0)  =  f(0)d0.  Since  X  is  also  minimal,  it  follows  from 
Theorem  3.3  in  Pourahmadi  (1984)  that  t  |J  ,  and  thus  if  g  tLa(f),  by 

Holder’s  inequality, 

11  _  1  -  1  nt-1 

fig:  =  flg|f“  f~*  <  (ff^  )  “  <  - 

and  hence  g  •  L  .  Thus  L  l(f )  L  .  Now  by  (3),  every  Y  M  has  a  unique 

-  X 

representation  Y  =  :ncnXn  in  M  .  Using  the  linear  isomorphism  Y=/gdZ  <—  g 
between  and  La(f),  it  follows  that  every  g  <  La(u)  has  a  unique  representa¬ 
tion  o(  )  =  c  e’in  in  La(f).  But  from  the  above  displayed  inequality  the 
convergence  is  also  in  iJ  ,  from  which  it  follows  that  c^  is  in  fact  the  n-th 

Fourier  coefficient  of  g.  Thus  the  Fourier  series  of  every  g  •  L^(f)  converges 

to  g  in  L'(f),  and  (4)  is  shown.  Conversely  assume  (4)  is  satisfied.  Fix 

Y  MX.  Then  v  =  TgdZ  for  some  g  <  L'*(f),  and  by  (4),  q(  )  =  in  L  l(f) 

X 

It  follows  that  Y  =  -  q  X  in  II  .  We  now  show  this  representation  of  Y  is 

•  nan  n 

unique.  Assume  we  also  have  Y  =  V  c  X  .  Then  g(‘)  =  •'  c  e*ln  in  L  1  ( f ) . 

n  n  n  J  n  n 
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Using  Lemma  3.1  in  Miamee  (1985),  it  follows  that  this  convergence  is  also  in 
L  and  hence  an  =  g  ,  the  rrth  Fourier  coefficient  of  g.  Thus  every  Y  «  M'  has 
a  unique  representation  Y  =  />n9nxn>  showing  (3). 

The  equivalence  of  (4),  (5)  and  (6),  with  dg(0)  =  f(G)dP  added  on  is 
established  in  Hunt  et  al . ( 1 973 ) ,  Theorem  1  .  Here  we  shall  show  that  the 
weaker  statement  in  (6)  is  equivalent  to  (2).  An  argument  as  in  Helson  and 
Szego  (1960),  pp.  129-130,  shows  that  (6)  is  equivalent  to  the  boundedness  of  the 
truncation  operator  T  from  La'(u)  into  itself  defined  by 

r  ,  Jn0 

T(  /  c  e  )  =  )  c  e  , 
v  ’  n  n  ’ 

n=-go  n>0 

which,  considering  the  isomorphism  e  1ntJ  <— X  ,  is  equivalent  to  part  (ii) 

X  X 

of  Proposition  11  and  hence  d(P  ,F  )  >  0,  i.e.  (2)  which  completes  the  proof. 

Condition  (3)  is  the  crucial  one.  It  means  that  every  r.v.  Y  in  tne  linear 
space  M  of  the  sequence  X  =  {X^}  can  be  written  uniquely  as  a  converging 
series  in  terms  of  the  r.v.'s  X  :  Y  =  )b  X  .  Thus  every  linear  estimator 
based  on  an  observed  part  of  X  can  be  realized  by  a  unique  linear  filter  acting 
on  X .  In  particular,  under  any  of  the  equivalent  conditions  of  Theorem  3, 
which  are  stronger  than  those  in  Theorem  1,  the  moving  average  representation 
of  Theorem  1  can  be  inverted  to  express  the  sequence  of  innovations  (V  }  as 
a  convergent  series 


v  =  y  b.  x  . , 

n  kf0  k  n-k’ 


and  the  m-step  ahead  linear  predictor  X  ,  of  X  ,  based  on  X,  ,  k- n •  can 

n+m,m  n+m  k 

be  written  in  the  form 


f  ,  X 


n+m,n  m,k  n-k’ 


i.e.  it  can  be  realized  by  the  filter  c'm  =  u'm  ]<}|<>q  acting  on  the  observed 
part  of  X.  These  series  converge  with  respect  to  the  norm  or  equivalently 

in  LP(-.).  While  condition  (A  )  guarantees  that  all  functions  in  Lu(f)  have 

y 

convergent  Fourier  series,  and  all  r.v.'s  in  M  can  be  written  as  convergent 

series  in  terms  of  the  r.v.'s  X  ,  substantially  weaker  conditions  can  be  found, 

in  between  those  in  Theorems  1  and  3,  which  are  sufficient  for  the  innovations 

to  have  a  convergent  series  representation  (I)  in  terms  of  the  observed  values 

of  the  process  X  itself.  However  we  postpone  a  discussion  on  this  to  the  end 

of  this  section,  in  order  to  first  explore  the  relationship  between  the  existence 

of  (I)  and  the  existence  of  auto-regressive  representations  of  the  predictors. 

The  metric  predictor  of  a  harmonizable  symmetric  processes  has  been 

considered  in  Hosoya  (1982)  and  Cambanis  and  Soltani  (1984)  and  the  one  step 

ahead  metric  predictor  X  has  been  obtained.  In  terms  of  our  results  here, 

n+  I  ,n 

the  one  step  ahead  metric  predictor  can  be  written  as 

CO 

Xn+l,l  =k^akVn+l-k 


(cf.  Theorem  1.(5)).  The  problem  of  obtaining  the  m-step  ahead  metric 
predictor  n  in  the  general  case  is  still  open,  cf.  Cambanis  and  Soltani 
(1954)  for  more  details. 

Now  we  consider  the  right  angle  m-step  predictor  X^+n.  n  which  is  the  richt 

x 

angle  projection  of  X  m  on 


xr  =  a  (x  :mx). 
n+m,n  r  n+m  n' 


While  this  right  angle  predictor  may  not  exist  (Proposition  7 ( i ) ) ,  the 
following  proposition  shows  that,  when  it  exists,  it  is  in  fact  the  truncation 
of  the  mo  vino  average  o-p/er  in  Theorem  1,  extendin'1  to  this  predictor  a  nice 
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property  from  the  Gaussian  case. 


Proposition  12.  (i)  If  the  m-step  right  angle  predictor  Xn+ffi  n  exists  then  it  is 


given  by 


('  =  J  a,T  .  . 

n+m,n  , L  k  n+m-k 
k=m 


(ii)  If  the  regression  E(Xn+mjM^)  is  linear  then  the  right  angle  predictor 

X"  exists  and  we  have 
in+n,n 

/N  a‘ 

X"  =  E(X  x  IMX)  =  7  a.  V  A  .  . 
n+m,n  n+m‘  n-  k  m+n-k 


Proof,  (i)  If  the  m-step  ahead  right  anqle  predictor  X  exists  then  it 

—  - —  '  r  3  n+m,n 

X  V 

is  in  M  and  hence  in  fl  .  Now  Theorem  3,  applied  to  the  innovation  process  V 
n  n  y  n 

X 

shows  that  - V  •  is  a  Schauder  basis  for  M  .  (This  is  because  the  density  of 
n 

V  is  simply  the  Lebesgue  measure,  which  clearly  satisfies  the  (A  )  condition 
of  Theorem  3).  Thus  one  can  write  X^+m  n  as  a  convergent  series 


X  \  =  ;  c,  V  A  .  . 

n+m,n  ,  -  k  n+m-k 
k=m 


Now  by  the  definition  of  right  angle  projection  we  have 


tor  every  Y  in 


ibis  snows  that 


[Xrx  , Y ]  =  [X  .  , Y] 
L  n+m,n  J  L  n+m  J 


and  in  particular  for  Y  =  ,  with  k 


[Xrx  ,V.  ]  =  [X  .  ,VJ,  k  •  n. 
L  n+m,n  k  L  n+m  kJ 


a  .  =  c . ,  for  all  i  •  m. 

i  l 


n;  i .e.  we  have 


which  completes  the  proof  of  (i).  The  proof  of  (ii)  is  now  immediate  fro; 
part  (ii)  of  Proposition  7. 


*  ^  «  1  *  "  •  •  *  »  •  *  «  *  ■  §  ’  *  *  i  *  .  *  . 

J*  ‘  ■  ’«•  '  *  ‘  * 
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The  last  proposition  shows  that  when  the  right  angle  predictor  exists 
it  can  be  obtained  through  a  filter  exactly  similar  to  the  standard  one  in 
the  Gaussian  case.  This  can  be  used  to  show  that  the  problem  of  inverting 
the  moving  average  representation 


to  obtain  a  moving  average  representation  for  the  innovations 
<»  Vn  - 

is  equivalent  to  the  existence  of  a  series  representation  of  the  one  ste 


ahead  metric  predictors ,  in  terms  of  the  observed  values  of  X  itself 


n+1,1  =,LdkXn-k’ 


and  this  is  equi valent  to  the  series  representation  of  all  the  existing  righ t 


angle  predictors  X  in  terms  of  the  observed  values  of  X  itself 

— 2 - r -  n+m,n  — — - - 


'Apin> 


X  .  =  V  e.  X 

n+m,n  ^  k,m  n-k 


The  equivalence  of  (I)  and  (Pj)  can  be  established  in  the  time  domain.  Indeed 

assume  that  (I)  holds.  The  orthogonality  of  Vn's  implies  that  for  every  Y  in 
XV  - 

M  =  M  we  have  [Y,V„ .-.j  =  0. Using  (4)  of  Theorem  1,  we  obtain 

n  n  n+ 1  a  2 


[Vn+l  ,Vn+Ax  =  *-J0bkXn+l-k,Vn+Ai  Wl’VlA 


bO[jodkXn+1-k’Vn+l]"  =  b0a0^Vn+l  ,Vn+l\ 

_  1  v  ,co 

and  thus  b^  =  8q  >0.  Now  it  follows  from  b0Xn+l  =  Vn+1  '  ■  k=lbkXn+l -k 
that  Xn+1  ,n  =  'hQ1  A=lbkXn+l-k  =  5=0( -bk+l/b0)Xn-k  and  thus  (Pl>  is  satisfied 


Conversely,  assume  (Pj  is  satisfied.  From  (3)  and  (4)  of  Theorem  1,  we  have 


Xn+1  '  Xn+1 ,n  =  a0Vn+l  ’ 


and  thus  by  (P  ) , 


Vi  -  ao’<Vl 


k=0 


d,  .  X  ,  ) 
1 ,k  n-k' 


k=0 


b.X  i i 
k  n+1  -k 


with  bQ  =  a'1  and  bk  =  -d^-j/dg,  k  _>  1 .  So  (I)  holds.  The  equivalence  of 
(I)  and  (AP  )  follows  from  an  appropriate  adjustment  in  the  proof  the 
corresponding  fact  for  the  second  order  case,  as  qiven  in  Bloomfield  (1904), 
together  with  the  representation  of  X^+m  n  given  in  part  (i)  of  Proposition  12 
Considering  the  isomorphism  between  the  time  domain  and  spectral 
domain  we  see  that  a  necessary  and  sufficient  condition  for  (I)  to  hold  is 
that  c’1  has  a  series  expansion 


(F)  <fV)  =  L  Vik0, 

k=0  K 

converging  in  l*(f) . 

While  condition  (F)  is  necessary  and  sufficient  for  the  convergent 
series  representations  (I)  and  (P)  of  interest  to  us  here,  it  is  not  easily 
checked  (and  no  easily  checked  necessary  and  sufficient  condition  is  available 
even  when  t=2) .  Following  are  some  sufficient  conditions  which  are  easier  to 
check.  The  simplest  is  the  one  suggested  by  Masani  (1960): 

(M)  f  <  L"  and  f"1  e  L1. 


A  different  condition  is  given  in  Theorem  3:  (A^).  The  fact  that  (A() 
implies  the  convergent  series  representation  (P^)  has  also  been  shown  in 
Pourahmadi  (1985).  A  weaker  condition,  generalizing  both  conditions  (A  ) 
and  (M),  can  be  proved  similarly  to  Theorem  4  in  Bloomfield  (1984.),  where  the 
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case  a  =  2  is  considered: 

(8)  f  =  hq  where  h  satisfies  (A  )  and  g  >  0  satisfies  (M). 

The  following  are  yet  weaker  conditions. 

Proposition  13.  Let  X  be  regular  harmonizable  SaS  with  1  <  a  <  2,  and  let  * 

De  the  outer  factor  of  f  (cf.  Theorem  1.(3)).  Then  any  of  the  following 
conditions  implies  (F). 

(a)  f  =  h, g-|  +  h^g^  where  h.,g^  >  0,  h.  satisfies  condition  (A^),  and  g..  satisfies 


condition  (M),  i  =  1,2. 


-1  ,  1 


(b)  h  |  ■_  f  <  q2h2  where  h.  ,g^  ■  0,  g”  .  L  ,  •  L  ,  L'  ( h  ^ )  =  L  (h^)  and 

h,  satisfies  (A  ) 

I  t 

Proof.  (a)Clearly  f  h.qi ,  for  i  ^  1,2,  so  f-1  *'  (h.jg..)~\  and  hence 


.  -1  , 


'i  ‘  f 


’  V- 


1  -)  N 

Trus  L'(h.).  Now  since  h^  satisfies  (Aj  by  Theorem  3  we  see  that  (■'  )  ,  the 

N-th  Fourier  partial  sum  of  :  ,  converges  to  ;  in  L  (h.)  and  hence  in  L  ( h  g  ^ ) 

( necause  g ■  ■  L  ) ,  i .e. 

'  (:‘1)N  -  ’  °’  1  = 

J 

Adding  these  two  together  we  get 

■  /  .  “I  \N  —  1  I  r\ 

,  ,  ( v  )  -  <t  ;  f  -  0 , 


wmcn 


completes  the  proof  of  (a),  (b)  can  be  proved  by  adjusting  the  proof  in 


lloorrfield  (1985). 


■V'vV 


As  an  application  of  Proposition  13  one  can  verify  that  a  second  order 
stationary  stochastic  process  with  spectral  density 

f(6)  =  |1  +  e1®!1 ,5  +  |1  +  e"10 10,5 

"i  A  o 

has  the  representations  (I),  (P)  and  (Q  ).  We  know  that  |1  +  e  |p  satisfies 
(A^)  for  -1  <  p  <  1 ,  by  Helson  and  Szego  (1960),  and  (M)  for  0  £  p  <  1.  Thus 
we  can,  for  example,  take  g-j  =  |1  +  e^°j^‘®,  =  !l  e10;^’^, 

h,  =  i 1  +  ei0 and  h0  =  1 . 
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